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SUMMARY 



A STUDY OF THE SEMANTIC DIFFERENTIAL BASED ON 
MOTIVATIONAL CONCEPTS AS A TECHNIQUE FOR 
PREDICTING STUDENT ACHIEVEMENT 



Problem: Development of a semantic differential scale based on 

achievement motivation concepts by which grade point 
averages can be predicted. 

Methods and Procedures: A scale was constructed which was 

administered to 944 freshman students. Two approaches 
were used (1) a check of the extent to which the scale 
would predict for students having the same level of 
academic aptitude, and (2) by including academic apti- 
tude as a variable with semantic differential scales into 
a multiple regression equation. 

Results: In each group of subjects for several stratifications 

(sex and intelligence) multiple R's were found which were 
significant above the .05 level of confidence. 

Conclusions: The semantic differential technique constructed from 

achievement motivation concepts can predict grades. The 
scale used here is not satisf*ictory for predictive pur- 
poses but through further study and improvement it possibly 
could become extremely useful for screening, counseling, 
and/or admittance purposes. 
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CHAPTER 1 



INTRODUCTION 

This study was concerned with the development of a semantic 
differential scale related to motivational concepts. More speci- 
fically, the study investigated the extent to which the semantic 
differential scale predicted students' college achievement as deter- 
mined by their grade point average. 

Need for the Study 

In 1950 there were 2,214,000 students enrolled in institutions 
of higher learning; by 1960 there were 3,570,000; and by 1966 there 
were 6,085,000. Projections have indicated that there will be 
7,296,000 students by 1970 and 9,088,000 by 1975. Between 1950 and 
1960 the total college population increased 61.7 per cent, and between 
1960 and 1966 it increased 70.4 per cent. Projections based on known 
population increase and probable human fertility rates have indicated 
an even greater per cent of increase in the number of college students 
in the more distant future (U. S. Bureau of Census, 1964, 1968). 

In the growing complexity of our society, the demand is ever 
increasing for college trained personnel to fill professional positions. 
This demand, with the mushrooming number of college-age young people, 
is taxing the various institutions of higher learning beyond their 
capacity to adequately provide either facilities or instruction. 

To relieve over-enrollment, most institutions have devised selective 
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admission practices. Even with selective admission based on past 
achievement and scholastic aptitude scores, nearly half of the students 
who start to college do not finish. Research indicates that lack of 
scholastic aptitude can account for only a part of this failure. 
Likewise, there is relatively little understanding of the inner dynamics 
which direct the behavior of these individuals who possess the academic 
ability necessary to succeed but who fail to meet the established 
standards of the institution which they attend. 

Since World War II there has been a vast increase in research 
into personality factors which may affect academic success. Many 
of the studies have attempted to use existing personality instruments 
or techniques randomly to determine relationships between whatever 
the instrument measures and academic success. This procedure has 
not proved successful. Other efforts have been directed toward 
motivational factors which seemingly affect achievement. Specific 
scales which purport to measure achievement motivation have been 
designed and show promise, but currently they are unable to predict 
at a level higher than instruments measuring intellective factors. 
Combinations of intellective factors and non-intellective factors 
have not proved to be sufficiently valuable to be used for other 
than continued research. 

The problems inherent in selection of college students continue. 
Although the existing predictive devices may eventually be revised 
and refined to the degree that they adequately serve their intended 
purpose satisfactorily, the history of their development indicates 
that their refinement is a slow process. Likewise, there is some 
indication that predictors using cognitive functions have reached 
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an impasse in their ability to predict. 

A technique whicli has not been sufficiently investigated but 
which shows logical promise as an academic predictor is Osgood's 
(1957) semantic differential. The present study was designed to 
investigate the semantic differential technique applied to motiva- 
tion concepts as a means of predicting academic success ^ More 
specifically this study will investigate the ability of a semantic 
differential scale using motivational concepts to: 

1. predict the extent to which students of equal ability will 
differ in achievement. 

2. combine with existing academic aptitude scores to provide a 
better predictive device than either measure can provide 
alone. 



Definitions of Terms Used 

In this study the following definitions were used; 

Academic aptitude is the composite score achieved by the student 
on the American College Test . 

Criterion of achievement is the student's grade point average 
for the semester in which the index of motivation was assessed. 

Limitation of the Study 

Tlie study was limited to the investigation of motivational 
concepts as assessed by semantic differential scales as a factor 
in scholastic achievement of freshman students at Northeastern State 
College. 



Review of Literature 



In this section is presented research concerning college drop- 
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outs, admission practices, and prediction of academic achievement. 
Prediction is examined on the basis of both intellective and non- 
intellective factors. Particular attention is given to the various 
methods by which the personality factor— motivation has been assessed. 
Basic shortcoming discovered in the review of achievement prediction 
research are discussed. 

Unfortunately being admitted to college provides no guarantee of 
completion of an academic program. Not every student who enters college 
will finish or even complete the first semester. Summerskill (1962) 
indicated that approximately half of those entering do not finish. Two 
studies by Iffert (1957, 1965) provided information concerning the 
national drop-out problem. In his 1957 study representing a sampling 
of 13,700 students enrolled in the fall of 1950, he found that only 
40 per cent of the freshmen would remain for graduation four years 
later. Through transfer iad re-entry about 60 per cent would eventually 
receive degrees. He stated, "The first year of college is the most 
critical dropout period... 273 left school within th® first year in 
comparison with 283 per 1,000 during the next 3 years." His 1965 
study included 1,000 selected enrollees in twenty different institu- 
tions of higher learning during the academic year 1957-58. He found 
that 2,398 of those students dropped out or did not re-enroll the 
following semester. The major reasons for leaving college were 
academic (45.8 per cent), health and family problems (25.2 per cent), 

and financial (15.0 per cent). 

A study by the Oklahoma State Regents for Higher Education 



(1964) of the students entering Oklahoma institutions of hi >her 
learning in the fall of 1962 discovered: 
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...some 836 out of every 1,000 freshmen. . .enrolled in the 
institutions of first registration at the beginning of the 
second semester. After two semesters had elapsed, however- - 
by the beginning of the following fall--only 581 students 
per 1,000 were still enrolled in the institution of first 
registration 

The total number of drop-outs or non-retumees for the academic year 
1962-63 was 4,767 of 13,326. The median grade point average for those 
leaving at the end of the first semester was 1.5 (4.0 ■ A). 

Above average students also have retention problems. Hill 
(1966) found that 37.5 per cent of 628 above average freshmen admitted 
to the University of Texas in the fall of 1959 had withdrawn prior 
to completion of a degree within five years. Twelve and seven-tenths 
per cent of those withdrawing were enforced academic withdrawals. 

Twelve per cent of the females and thirty-six per cent of the males 
withdrawing were on academic probation at the time of withdrawal. 

It is painfully evident that not all students who enroll in 
c* J >ge are academically qualified or if qualified are not sufficiently 
motivated to put forth enough effort to be academically successful. 

Adi sion selection procedures have been in effect in many pres- 
ige ins tutions for years. These procedures have been extended to 
state universities and colleges in the past two decades. Iffert 
(1965) found that the twenty institutions he studied admitted only 
sixty-one per cent of their applicants as early as 1956. Oklahoma 
has recently instituted more stringent entry levels for certain 
institutions while allowing entrance to other institutions for all 
who choose to attend them or for students who do not qualify for the 
more selective institutions. Drop-out figures indicate that the present 
basis of selection does not function satisfactorily. A review of 



the bases on which students are selected for admission seems 
germane to this study. 

Intellective factors are currently the most used bases for 
admission. They include high school achievement, intelligence, 
academic aptitude, and scores on general achievement tests. In 
a summarization of 580 admission studies by Fishman and Pasanella 
(1960), 263 studies used high school grades as predictors. High 
school grades correlated roughly .50 with the first year college grades. 
Garrett (1949) and Smith (1964) cite the high school academic record 
as the best single predictor of college grades. Fishman and Pasanella 
also found that "...because secondary schools vary widely in standards, 
students, and curriculums, most colleges found it important to include 
some standardized aptitude and/or achievement tests in their selection 
measures." In the studies cited, they found such commonly used 
scholastic aptitude tests as the American Council on Education 
Psychological Examination , the Ohio State Psychological Examination , 
and the Scholastic Aptitude Test had an average correlation of .47 
with the freshman grade point averages. Intelligence tests such as 
the Otis were not found to be useful in prediction of grades as 
aptitude and/or achievement tests. 

Fishman and Pasanella (1960) also found many multiple-correlation 

studies : 

In 216 which employed only intellective predictors, the 
multiple-correlations with freshmen average ranged from 
.37 to .83 with a median of .62. 

... In 21 studies which used an aptitude test and the high 
school record,, the multiple-correlation was increased any- 
where from .00 to .23 beyond the zero-order correlation 
based on high school average alone, with a median rise of 
.07. In general, the use of any one intellective predictor. 



or more than one, with the high school record improved 
the forecast of freshman average in 181 studies by .00 
to .38, with an average gain of .11. It seems useless, 
however, to employ more than two or three intellective 
predictors, from both the point of view of practicality 
and of efficiency. 

Frederiksen and Schrader (1962) summarized the findings of several 
predictive studies of freshmen veteran and non-veteran students. The 
studies utilized the American Council on Education Psychological 
Examination ( ACE) , which is an academic aptitude test; the grade 
point average in college; and high school rank. A median correlation 
of first year grades and high school rank was .57. Median multiple- 
correlations for veterans and for non- veterans were .60 and .68 
respectively when high school rank and ACE scores were used as predictors. 

A correlation of .59 was found by Punches (1965) between the 
first-year grades of 369 freshmen and their American College Test 
composite scores. Another study utilizing the ACT was conducted by 
Foster (1962) at Kansas State University. Correlations between various 
subscores of the ACT and typical college courses were .60 or higher 
except for oral communications, which was .45; calculus I — .42; 
accounting I— .48. In a study just completed, Dobbins (1969) found 
a correlation of .47 between composite ACT scores and first semester 
grades of 1,125 Northeastern State College freshmen. Although little 
research has been published other than by the publisher of the American 
College Test , the P£T^ is currently in use in some 13,000 institutions 
in fifty states as a required procedural step in securing admission to 
the institution. 

In summary of research concerning intellectual factors, high 
school grades or rank and academic aptitude or achievement tests 
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have been in wide use as predictors of college grades • Many studies 
showed that high school achievement is the best indicator. Correlation 
coefficients for intellective factors and achievement range up to about 
.60. Even with continued refinement the correlation between intellective 
factors and achievement will probably not climb much higher. 



Non-intellective factors 



Fishman and Pasanella (1960) found thirty-three studies which 
used non-intellective factors as academic predictors prior to 1960. 

These studies utilized such personality factors as the Rorschach , 
Minnesota Multiphasic Personality Inventory , Manifest Anxiety Scale, 
and various biographical data. The correlations between these 
instruments and academic success ranged from .01 to .62 with a median 
correlation of .22. Interest inventories yielded lower correlations 
ranging from .05 to .26, although only seven interest studies were 
reported. Correlations of age and socio-economic status with achieve- 
ment were not significant. 

Garrett (1949) found practically no correlation between personality 
in general and scholastic achievement in studies conducted prior to 
1949. Gough (1953, a) questioned the wisdom and efficiency of earlier 

studies. 

...most of the personality tests used were based on ineffi- 
cient, a priori methods of test construction, and could 
hardly Be depended upon to yield a valid assessment of per- 
sonality factors. 

Second, the typical approach was the rather aimless empirical 
one of merely correlating a series of test scores with grade 
averages to see what might be discovered. ♦•the personality 
scales themselves were not constructed with any regard for 
problems of academic achievement, and would, accordingly, 
only in the most fortunate cases contain relevant and 
properly weighted items for such a task. 
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In order to overcome the deficiencies noted, Gough (1953, a) 
constructed a thirty-eight item true-false scale (ACj.) and adminis- 
tered it to 234 high school seniors. The scale correlated .47 with 
grades. A multiple-correlation of IQ and Acr with grade average was 
.62. The Acr was administered to 180 college students and correlated 
only .18 with their introductory psychology grades. Gough concluded 
that college and high school grades are determined by a somewhat dif- 
ferent constellation of factors. 

In order to further study prediction of college grades, Gough 
(1953, b) developed a second personality scale (honor point ratio). 
The scale consists of 36 items which the student accepts or rejects. 

It was administered to 1,253 students. The scale correlated .38 with 
psychology course grades. Observers tended to rate those students 
scoring high on the ^ scale as capable, intelligent, and reliable 
in contrast to those scoring low who were described as dissatisfied, 
dull^ rigid, and shy. 

Barnette (1961) used Gough's ^ scale to predict grades. He 
combined the Hr scale with the Iowa Picture Interpretation Test 
(projective technique). Only the Hr was found to be a useful pre- 
dictor; the correlation between Hr and two semesters of college grades 
was .38. These results are in keeping with the results of other 
attempts to add projective scores to other factors as noted by Fishman 
and Pasanella (1960). Barnette also combined the Hr and scores from 
the Cooperative English Test to predict first year college grades. 

The resulting multiple correlation was .45. 

Another attempt to predict grade point averages using the Hr 
scale was made by Bendig and Klugh (1956). A correlation of .32 was 
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found for grades and Hr scores of 422 introductory psychology students. 
IVhen IJjr scores and high school rank were compared to grade point 
averages for one year, the multiple correlation was o45. 

Van Zandt (1961) developed the Achievement-Affiliation Motive 
Scale ( AAMS) with which to assess motivation of teachers. The scale 
was designed to be scored objectively and to be administered by non- 
psycho logically trained people. Smith (1964) used the AAMS in con- 
junction with various intellective predictors in an attempt to pre- 
dict grades for college freshmen. Multiple regression analysis of his 
data indicated the high school achievement record to be the best pre- 
dictor of college success. Scores of the AAMS did not add signifi- 
cantly to prediction of academic success. 

Another such attempt was made by Garms (1967) in which various 
items gleaned from instruments designed to measure personality traits 
were related to academic achievement. Factor analytic techniques 
identified items contained in the California Personality Inventory , 

The Minnesota Multiphasic Personality Inventory , The Edwards Personal 
Preference Scale , and Adorno's scales relating to ethnocentrism and 
authoritarianism. This scale showed a significant relationship to 
scholastic achievement. 

A multiple regression equation combining Garms' scale with 
Scholastic Aptitude Test - Verbal scores yielded a correlation be- 
tween predicted and achieved grades of .59 (significant at the .01 
level of confidence). Sizemore (1968) using an adaptation of Garms' 
scale for predicting introductory psychology grades, found a corre- 
lation between the scale grades and actual grades in psychology of .60 
for 199 students (significant at the .001 level of confidence). 
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Another attempt to replicate the Farquhar findings but with 
college freshmen as subjects was made by Hayden (1962). She found 
a low-positive relationship between the M- Scales and academic achieve- 
ment in males. There is no significant relationship between the 
M- Scales and academic achievement for females. Likewise, there was 
no significant relationship between either male or female M- Scales 
scores and academic aptitude. Multiple correlations between academic 
aptitude and academic achievement were not significantly increased by 
adding sub- or total M- Scales scores to the estimates. 

Another approach which has promise of being developed into a 
capable predictive device is McClelland's (1953) need for achieve- 
ment (n ach) technique- a projective technique which is an adaptation 
of the Thematic Apperception Test . McClelland's rationale for -develop- 
ment of this technique was guided by three hypotheses: (1) The method 

of measurement for maximum theoretical usefulness should be at least 
partially independent of the methods of measurement used to define 
the other two main variables in contemporary psychological theory — 
perception and learning. (2) Motives might best be measured in phan- 
tasy which fulfills the first requirement, since it differs radically 
from other methods of measurement. (^ Motives could be experimentally 
aroused by manipulating external conditions prior to assessment of the 
motive in question. This method differs from global projective tech- 
niques, since it was structured specifically to assess achievement 
motivation and was scored according to the dimensions of (1) long term 
involvement, (2) unique accomplishment, and (3) competition with a 
standard of excellence, all of which McClelland hypothesized to con- 
stitute need for achievement. 
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McClelland, et. al, (1953) reported a study in which his version 
of the (now called McClelland Need Achievement Test—MNAT ) was 
used as the measuring device by which need for achievement (n ach) 
scores were derived. A correlation of .51 (significant at the .01 
level of confidence) between n ach scores and the grade point average 
of the two previous semesters was found when the n_ ach scores were 
compared with SAT scores, the relationship was found to be .42; when 
the correlation was adjusted for the effect which the SAT scores 
presumably had on the correlation, the relationship between n ach 
and grades was still significant at .39. 

Lowell (reported by McClelland, 1953) found little correlation 
between n ach scores and predicted grades. The acl^ scores used 
by Lowell were not from the same scale used in the previous study, 
and Lowell had reason to doubt the cooperativeness of many of his 
subjects. He also found that the arousal conditions preceding the 
administration of the scale affected greatly the degree of relation- 
ship which could be expected. 

Morgan (reported by McClelland, 1953) held academic aptitude 
constant (his subjects had all scored above the 96th percentile on 
the ACE -- Total) and compared grades of "achievers" and "non-achievers" 
with n ach scores. Forty "achieving" students had a grade point average 
of 2c 1 or better, and thirty "non-achievers" had less than 2.1. He 
found that those students with high academic grades obtained reliably 
(p >o02) higher n ach scores than did those students with low academic 

grades . 

To an investigation of the effect of social class upon achievement 
motivation which provides an internal impetus to excell and value 
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orientations which define and implement achievement motivated behavior, 
Rosen (1958) used the MNAT to determine the extent to which need for 
achievement existed in his male, high school sophomore subjects. 

Among his findings was the indication that n ach is an important 
determiner of academic success: 69 per cent of those students rating 

high on n ach made a "B" grade point average or better, while only 35 
per cent of those having a low n ach had a "B" or better average . 

The probability of this occurrence by chance was less than .001. 

LaVerd (1960) utilized McClelland's (1953) technique in assessing 
through phantasy, the motivation level of 105 eighth grade students. 

He used four pictures which he chose for the TAT . Achievement was 
determined through the administration of the California Achievement 
Test, and intelligence was assessed through administration of the 
California Test of Mental Maturity . His motivation index correlated 
.52 with the achievement for the total group. Boys' motivation scores 
correlated .45 with achievement, while girls' scores correlated .64. 

All correlations were significant above the .01 level of confidence. 

With this group a multiple-correlation of motivation and intelligence 
scores with achievement scores was .88. However, the cc’^relation 
between intelligence and achievement was .89. In a pilot study using 
somewhat different scoring methods for the motivation scale, the 
multiple correlation for boys was .93 and for girls was .98. However, 
in the pilot study the correlation between achievement and intelligence 
was only .43. The statistics cited are indicative of the ability of the 
method to predict achievement, but many questions would need solutions 
before the method could be utilized for purposes other than research. 

In 1964 Dove used the MNAT and the Iowa Tests of Educational 
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Development to assess the relations between n a* and achievement. 

The resulting rank-order correlation for sixty-one students was .234, 
which is low but approaches significance at the .05 level of confi- 
dence. Her n ach scores were also correlated with grade point averages 
for the same students. The resulting rank-order correlation was .38, 

which is significant at the .01 level of confidence. 

The studies by McClelland and his associates (1953) indicated 

that the conditions under which the n a* test is given, play a large 
part in the score which a subject would obtain. If achievement arousal 
conditions were instigated prior to the administration of the test, 
the subject would achieve a higher score. It was this score which 
was used in the majority of the studies in which significance was 
found. If the test must be given under achievement arousal conditions 
in order for significance to occur, further problems concerning the 
methods by which large groups are aroused must be determined if the 
test is to be used extensively as a predictive instrument. Studies 
by Wendt (1955) and Herron (1962) focus in part on this problem. 

Wendt (1955) using the MNAT and a group of fifty-two high school 
and college students, found that those subjects who obtained a higher 
n ach score expended greater effort and obtained better quality on an 
arithmetic task. Tasks were administered under both scheduled and 
unscheduled ( free-time) conditions. Subjects who had a higher n ach 
score worked proportionately harder than subjects with low n ach 
scores during unscheduled conditions. During scheduled conditions 
the work output of subjects with low n ach was sharply increased 
although significance reached only the .15 level of confidence. The 
n ach tests were given under what would be considered scheduled 
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conditions. 



Two findings from a study conducted by Herron (1962) seem to be 
pertinent to the question of differences in scores on projective 
techniques obtained under different arousal conditions. Herron 
used the Holtzman Inkblot Test ( HIT) and the Test of Insight (TOI) 
with 180 subjects assigned randomly to an achievement arousal condition 
and to a neutral condition. The HIT is similar in nature to the 
Rorschach ; the TOI is a ten statement test in which a respondent 
is asked to write a story about the statement. The TOI_ was designed 
to be used in lieu of the or MNAT with college students in studies 
of motivation. It is scored in the same manner as the MNAT . Neither 
the HH or the TO^ yielded significant correlations with grade point 
average. The scores achieved under the two conditions, neutral and 
achievement arousal, were significantly different. 

McClelland’s Need Achievement Test has not been used extensively 
in attempts to predict academic achievement. Correlations from the 
various studies have been predominantly low; and if significant, they 
just meet the minimal standards for significance. Other problems also 
seemingly limit the practical utilization of the MNAT . The pictures 
which comprise the test can be shown to a group via opaque projection, 
the stories can be written in mass, but scoring remains an individualized 
process. Scoring scales, which aid in achieving objectivity, have 
been developed and by their use reliability has been greatly increased. 
However, the sheer weight of time required to score the stories seems 
to prohibit the utilization of the instrument, even if greater refine- 
ment and thus greater prediction can be attained. Another problem 
which is far more serious is that this device with the exception of 
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one study has shown little ability to predict any type of motivation 
for females. 

Intellective devices, although far from perfect, are in wide 
use in an attempt to identify students who can and hopefully will 
succeed in their academic endeavors. The loss of many students who 
are identified as capable is indicative of other factors which also 
must affect academic success. The use of various global personality 
tests and scales which have been designed to identify the extent to 
which an individual possesses some personality characteristic con- 
sidered necessary for academic success has not proved to be of 
sufficient value in predicting academic success to be used widely 
as an admissions screening device. Combining intellective scales 
with nrn- intellective scales has likewise proved unprofitable. 

Semantic differential 

An approach which is receiving wide utilization in other areas 
but which has not been sufficiently studied as a possible technique 
by which academic prediction can be made is Osgood's (1957) semantic 
differential. The technique has obvious advantages: it is easy to 
construct, requires a minimum of administrative time, and is clearly 

amenable to machine scoring. 

The literature revealed three studies in which the semantic 
differential technique had been used as a means of studying achieve- 
ment. These studies have been presented in greater detail, since they 
have direct emphasis for the present study. Winter (1961) used a 
population of thirty-four male, freshmen students enrolled in intro- 
ductory psychology. His purpose was to check the relationship between 
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achievement and a student's ability to predict certain values which 
his instructor possessed. A semantic differential scale was composed 
of the following concepts: athletics, books, cheating, college, easy 

money, good time, grades, homework, play, professor, research, social 
activities, studying, tests, and work. Eight polar adjective pairs 
of evaluative nature were chosen from Osgood (1953). They were 
beautiful-ugly, clean-dirty, fair-unfair, good-bad, kind-cruel, 
nice-awful, sweet-sour, and valuable-worthless. Scoring was on a 
1 to 7 scale per polar pair, and a student's score was obtained by 
correlating each of the concepts with grade achievement in elemen- 
tary psychology. The following correlations were found: the seman- 

tic differential score correlated with the ACE-Total — .36 (signi- 
ficant at the .05 level of confidence); with the ACE-Qualitive -- 

» 

.13 (non- s ignifi cant ) ; with the ACE-Linguistic -- .40 (significant 
at the .01 level of confidence); with Father's education -- .04 (non- 
significant); with Mother's education — .26 (non-significant); with 
the predicted orientation of the professor — .38 (significant at the 
.05 level of confidence); and, discrepancy scores derived by subtracting 
the difference between a student's orientation from the orientation of 
his professor -- -.46 (significant at the .01 level of confidence). 

A correlation between the ACE-L and the student-professor scale was 
only -.10, which was not significant. One conclusion drawn was that 
the instrument could be refined and used as a predictor of academic 
success. 

Meacham (1965) used the semantic differential technique in an 
attempt to develop a motivation scale which would correlate with 
grade point average, which was unrelated to academic aptitude, and 

,.T 
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which when added to known scores of academic aptitude would increase 
ability to predict achievement « The concepts used were self-appraisal 
(SA) and ideal-self (^). Sixty polar pairs were used, although only 
thirty which applied to motivation concepts were scored. From a 
seven point scale per polar pair, three sets of scores were obtained: 

SA, SI, and a discrepancy score which was the difference between SA 
and SI. A total of 220 junior college students were used as subjects. 
Grade point averages were computed for past college grades and for 
the current semester. Academic aptitude was measured by the American 
Council on Education-Linguistic ( ACE-L) . A random sample of 100 students 
was chosen, and their scores were used for reliability and item analy- 
sis checks. A split-half reliability coefficient was obtained for the 
SA and SI scores. An extension by means of the Spearman -Brown prophecy 
formula yielded reliability scores of .886 for SA and .878 for S^. 

A reliability coefficient (not split-half) for the discrepancy scores 
was .761. The correlation between ^ and SA was .523. An item index 
was computed by checking the scores of twenty- five students having the 
highest scores with twenty-five students having the lowest scores on 
the SA scale. With three exceptions the polar pairs discriminated be- 
tween the high and low groups at above the .05 level of confidence. 
Although some items discriminated much more than did others, all 
seemed to have value; therefore, none was discarded. The SA scale 
was administered, and then the SI_ scale was administered a week later. 
The time seemed sufficient for students to forget specific responses. 

The SA scores (ravj) were correlated with accumulative and current 
grade point averages. The correlations were .290 with a standard error 
of .062 for the accumulative grades and .377 with a standard error of 



.056 for the current grades c The correlation between academic apti- 
tude (ACE-L) and ^ scores was .036 with a standard error of .067, 
which does not differ significantly from zero. The ACE- L scores and 
grade point average correlated .450 with a standard error of .054. 

A multiple correlation combining ACE-L and ^ scores and comparing them 
with grade point averages was found to be .567 with a standard error 
of .045. Meacham assumed that grade point average was indicative of 
adjustment to an academic world, the higher the discrepancy score 
the lower the grade point average. The correlation between the 
discrepancy score and achievement was -.363 with a standard error of 
.058, significant at the .01 level of confidence. 

Meacham concluded: 

1. An index of motivation was developed using a measure of the 
self-concept and the semantic differential technique. 

2. The index of motivation was not correlated with academic 
aptitude but was predictive of the criterion, grade point. 

3. When combined with a measure of academic aptitude the index 

of motivation added to the predictive power of this instrument. 

4. The discrepancy score between the self-appraisal and self- 
ideal was negatively correlated with grade point. 

Meacham recommended that further study be made to improve the 

predictive power of the self-estimate with regard to motivation. A 

wider population of students was recommended so that the research 

could be more generally applicable. He stated: 

Further research in this area is warranted in order to 
increase the predictive validity of those instruments de- 
signed to predict achievement in a school setting. There 
is some indication that the predictors using cognitive 
functions have reached an impasse in their predictive 
power. An approach through the affective domain shows 
promise . 




19 



Rosenthal (1965) did not attempt to predict achievement, but his 
study of achievers vSo under- achievers has direct bearing on the current 
study. He used the semantic differential technique in an attempt to 

resolve the following questions: 

1. Are there significant differences between achievers and 
under- achievers in perceived meaning as shown in their 
respective rating of selected achievement-related concepts 
for each of the seven areas listed below? 

a. school experience 
bo family relationships 

c. social relationships 

d. self-concept 

e. authority relationships 

f. goal orientation 

g. moral and social values 

2. Does a pattern of characteristics distinguishing achievers 
from under-achievers appear to exist, with respect to differ- 
ences in semantic distances between selected pairs of achieve- 
ment related groups? 

3. Do the perceived meanings as shown in the ratings of the 
selected concepts vary along more than one dimension for 
achievement, intelligence and sex groupings? 

4. To what extent does intellectual ability contribute to the 
differences in perceived meaning as shown in the ratings 
of selected concepts? 

5o To what extent does sex influence perceived meaning as 

shown in the ratings of these achievement-related concepts? 

His subject population consisted of 1,114 students in the ninth 
grade. They were considered to be middle-class, Anglo-American. 

Twelve distinct groups were formed from the achievement level, in- 
telligence level, and sex. An expected achievement level in reading 
was determined from their scores on the California Test of Mental^ 
Maturity . The actual reading level was determined by administering 
the California Achievement Test . Under-achievers were those students 
who were one or more ;oars lower in reading ability than would be ex- 
pected and achievers were those not classified as under- achievers. 
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Intelligence levels were established from CTMM scores low IQ below 
91, average IQ between 91 and IIO, and high IQ above 110. 

Concepts used were selected to represent each of the seven areas 

presented. School experience was represented by teachers, grades, 
school, reading, and ideal teacher; family relationships by home, 
ideal parent, and parents; social relationships by most people, 
my best friends, class-mates, and grownups; self-concept by my school 
ability, how I'd like to be, and how my class sees me; authority 
relationships by authority, rules, and punishment; goal orientation 
by future, college, a job, graduating, quitting school, money, and 
success; moral and social vlaues by trying hard, cheating, something 
easy, and something important. Polar pairs were chosen from studies 
reported by Osgood (1957) on the basis of high factor loadings on 
three factors -- evaluation, potency, and activity, which were 
identified by factor analysis of experimental scales. 

Evaluation was represented by sweet-sour, fair-unfair, and 
pleasant-unpleasant; activity by fast-slow, sharp-dull, and active- 
passive; potency by heavy- light, strong-weak, and large-small. 

A seven-point scale was used between each polar pair. Scores 
were obtained by summing the polar pairs for each factor (evaluative, 
potency, and activity) under each concept. Distance scores on certain 
concepts were obtained following the procedure recommended by Osgood 
(1957). The scores for each of the twelve groups were compared on 
each concept through the analysis of variance technique. 

The following concepts were found to discriminate significantly 
between achievers and under- achievers above the .05 level of confi- 
dence: grades , reading and m^ school ability on the evaluative. 
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potency, and activity factors; ideal teacher , college and quitting 



School on the evaluative and activity factors; future , graduating 
and success on the evaluative factor; authority and something impor- 
tant on the potency factor; and, me^i how my class sees me and cheating 
on the activity factor. The concepts quitting school , cheating and a 
job were negatively discriminating in that non-achievers have larger 
scores than do achievers. The other concepts on the semantic differ- 
ential scale did not discriminate at a significant level, although 
most of them indicated trends in the same direction as those concepts 
which did significantly discriminate. Rosenthal found significant 
differences in the manner in which males and females responded to 
concepts on his semantic differential scale. He also found that 
subjects who were termed high in intelligence showed significant 
differences in the manner in which they responded to many concepts 
when contrasted with students termed low in intelligence. He con- 
cluded that intelligence and sex were factors which affected the 
manner of response to his semantic differential scale. 

Among Rosenthal's (1965) major conclusions were the following: 

(1) Ihe semantic differential technique was a useful tool in assessing 
the motivational and attitudinal aspects of achievement and under- 
achievement. (2) The results furnished additional support for the 
necessity of adopting a multivariable approach to the study of under- 
achievement. The failure of the individual to achieve academically 
at a level commeniurate with his ability was revealed by his under- 
lying attitudes toward himself, toward his environment, and toward 
others and was expressed in terms of his perceptions of relevant 
concepts which have been found to have significance for academic 
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achievement. (3) No attempt to diagnose or predict under-achievement 
could be made with the instrument in its present form. However, 
with continued research and refinement the diagnostic and predic- 
tive ability of the instrument might prove to be of considerable 
value to teachers and counselors. 

Summary 

From the review of the pertinent research, the conclusion that 
presently used predictive instruments are not very satisfactory 
seems warranted. The semantic differential as a technique for pre- 
dicting achievement has not been thoroughly investigated. Logically 
and theoretically, the semantic differential would seem to be an 
appropriate technique for measuring the motivational concepts which 
are believed to play a large part in student achievement. 

The next chapter will present the rationale on which the seman- 
tic differential was based and the design and procedures followed in 
the experiment. 
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CHAPTER 2 



THE SEMANTIC DIFFERENTIAL, EXPERIMENTAL DESIGN, AND PROCEDURES 



The purposes of this investigation were to explore the ability 
of the semantic differential technique to (1) discriminate between 



those students having the same academic ability by indicating those 
who will make high grades and those who will make low grades; and, 
(2) combine with existing academic aptitude scores as a better pre- 
dictive device than either measure can provide separately. The 
semantic differential technique is discussed and the experimental 
design and the procedures are presented in this chapter. 



The general design of the study may be summarized as follows: 

(1) The hypotheses to be tested must be stated. (2) The rationale 
of the semantic differential must be presented. (3) The semantic 
differential scale to be used in the investigation must be constructed. 
(4) The statistical methods must be determined. (5) The subjects to 
whom the scale is to be administered must be identified. (6) The 
scales must be administered; and then after an appropriate time 
lapse, the scale must )c re-administered to a random sample of the 
student population Jer to determine the reliability of the 
scales. (7) Academic aptitude of each student must be determined. 

(8) End-of-semester grades must be collected for each student. 

(9) Statistical treatment of the data must be performed. (10) The 



General Design 
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data must be analyzed. (11) Conclusions must be drawn. (12) The 
final report must be prepared. 

The remainder of this chapter will discuss the parts of the 
investigation listed above. 

Hypotheses 

The following null hypotheses were posed for statistical testing: 

1. There are no significant relationships between scores on the 
semantic differential scales devised for this study and 
grade point averages of students who have the same ACT 
scores. 

2. A combination of semantic differential scores and ACT scores 
does not predict significantly better than either measure 
will predict alone. 

Although not stated as a hypothesis the question of differential 
responses by males and females to the semantic differential scale will 
be studied. 



The Semantic Differential Technique 

The semantic differential technique is an attempt to measure 
meaning by using multi-dimensional discriminations of language be- 
havior. If meaning is conceived as an internal psychophysical event, 
then it must take on some of the properties of physiological mediation 
underlying the sensory functions as studied in traditional psycho- 
physics. Because sensory experiences are known to vary in kind and 
amount, meaning must also vary qualitatively and quantitatively. 
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Osgood, Suci, and Tannenbaum (1957) devised the semantic differen- 
tial technique in an attempt to determine the qualitative and quan- 
titative aspects of meaning. This technique allows a respondent 
to mark on a continuum his evaluation of a concept. Osgood used a 
seven point scale as his continuum and could by this procedure quan- 
tify the meaning which the concept had for the respondent on the parti- 
cular continuum. As many different continua as necessary could be 
used to define the range of meaning of the concept for the respondent. 

The semantic differential technique is in effect a method of controlled 
association using scaling procedures to define meaning operationally. 

The semantic differential is an indirect method of measuring meaning 
in the same sense that an intelligence test does not assess intelli- 
gence per se . Wherein an intelligence test attempts to place the re- 
spondent on a single continuum, the semantic differential technique 
makes use of the assumption that meaning is multi-dimensional, the 
number and intensity of the dimensions for an individual, depending 
upon his past experience. 

Factor analytic studies of meaning conducted by Osgood and 
associates (1957) identified three factors or dimensions of meaning 
which appear to be persistent and stable. The factors which were labeled 
evaluation, potency, and activity accounted for about sixty per cent 
of the reliable variance with the evaluative factor accounting for 
about one-half of the sixty per cent. Polar pairs (adjective con- 
tinuum scales) corresponding to each factor were identified by Osgood 
and were listed with their respective loading on each factor. It 
is possible, therefore, to select polar pairs which have a maximum leading 
on one factor and minimum loadings on the other factors. In most 



semantic differential scales, polar pairs representing each of the 
three factors- -evaluation, potency, and activity — are included. 

An example of a semantic differential scale as applied to the 
concept Mother follows: 



MOTHER 

good , > > > > 

s low , , I > > 

strong , , > I > 



bad 



fast 



weak 



The concept is place in the center above the polar pairs, and the 
respondent is urged to mark the polar pair scale in keeping with 
the direction and intensity which he feels for the concept. The 
scale is then scored for each polar pair by assigning values ranging 
from one to seven between the polar pairs, the seven is assigned to 
the space next to the most desirable of the two adjectives, and each 
Space further away is assessed one less number so that the space next 
to the least desirable adjective is scored one. The score on each 
concept is determined by summing the polar pairs which related to 
each factor used. The directions to the student include the admoni- 
tion to work rapidly in marking the degree of intensity which comes 
most readily to mind. Miron (1961) found that test-retest reliability 
was higher when students were encouraged to work rapidly. 



Reliability o£ th£ technique 

The usual method of determining reliability of a semantic differen- 
tial scale is the test-retest method. Osgood (1957); Jenkins, Russell, 
and Suci (1958, 1959); Norman (1959); and Miron (1961) have all re- 
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ported reliability coefficients determined from mean scores ranging 
from the high ,70's upward. Since these studies are almost univer- 
sally quoted when the question of reliability o5 a semantic differen- 
tial scale is considered, these studies are not recounted here. Other 
studies which are more recent and which illustrate the reliability 
of the semantic differential technique were reviewed. 

Green (1964) checked the reliability by administering his seman- 
tic differential scale to forty-five seventh grade boys. Six weeks 
later the scale was re-administered. The reliability coefficients 
for the evaluative factor on the concepts Me , Mother , and Father were 
.91, .89, and .91 respectively; the potency coefficients were .83, 

.90, and .88 respectively; and the activity coefficients were .86, 

.77, and .88 respectively. The level of significance for the coeffi- 
cients was not stated; but since they are relatively high and the 
number of subjects is adequate, significance seems assured. 

The reliability of a semantic differential scale was used by 
Marks (1965) to differentiate between psychiatric and normal patients 
on the meaning of personal and emotional concepts. The test-retest 
method and two time differentials--one week and seven months were 
used. For the normal patients the correlations on the evaluative 
factor and emotional concepts were .93 for one week and .87 for 
seven months; for the evaluative factor and the personal concepts 
the coefficients were q 84 for one week and .71 for seven months. 

All of these coefficients were significant at the .001 level of 
confidence, Marks concluded that the evaluative factor evidenced 
high stability for the concepts used. The coefficients for the 
activity and potency factors reached the ,001 level of significance 
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(with one exception), but the coefficients were not high enough to 
indicate stability for either personal or emotional concepts for 
either time period. Marks concluded that some of the variation in 
reliability which occurred between the factors could probably be 
explained by the greater number of scales used for the evaluative 
factor. Five scales were used for the evaluative factor, four for 
the potency factor, and onl) two for the activity factor. Marks also 
noted that the concepts showed greater instability than did the com- 
bined concept scores. 

Leach (1966) used both split-half with the Spearman -Brown pro- 
phecy formula and the test-retest methods to check the reliability 
of his Temperment-Translation Scales (a four part semantic differential 
scale having separate score summations for concepts dealing with emo- 
tional stability, sociability, personal relations, and thoughtfulness). 
The reliability coefficients for the test-retest method (n « 23) 
were .62 for evaluation, .85 for potency, and .90 for activity on the 
emotional stability scale; .83 for evaluation, .86 for potency, and 
.54 for activity on the sociability scale; .69 for evaluation, .76 
for potency, and .82 for activity on the personal relations scale; 
and .61 for evaluation, .83 for potency, and .57 for activity on the 
thoughtfulness scale. The results of the split-half method as extended 
(n s 144) were .62 for evaluation, .65 for potency, and ,66 for ac- 
tivity on the emotional stability scale; .81 for evaluation, .68 for 
potency, and .24 for activity for the sociability scale; .89 for 
evaluation, .81 for potency, and .82 for activity for the personal 
relations scale; and, .79 for evaluation, .45 for potency, and .59 
for activity for the thoughtfulness scale. Leach concluded that the 
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coefficient for the activity factor on the sociability scale was 
so low that its reliability was suspect. The other scales "...possess 
reliability of sufficient magnitude for practical measurement pur- 
poses." (p. 113) 

Since there is no "the" semantic differential scale and because 
each reliability study was conducted on a scale originated by the 
investigator to be used in his own unique study, the reliability found 
for one scale has no real relationship to the reliability of another 
scale. However, the over-all reliability for the vast majority of 
scales is universally high; therefore, a scale which is constructed 
thoughtfully and carefully should have sufficient reliability to be 
useful, but the reliability of each instrument must be uniquely 
determined . 

Construction of the scale 

Osgood (1957) stated that the construction of any semantic 
differential scale must be adapted to the research problem to which 
the scale is to be applied. The selection of the concepts and polar 
pairs for use in a particular study depends upon the purposes of the 
research. The investigator simply uses "good judgment" with respect 
to his problem. He should select concepts on which he can expect 
considerable individual differences to be shown, concepts which have 
only a unitary meaning for the subjects, and concepts which are 
familiar to all subjects. The evaluative, potency, and activity 
factors accounted for over half the variance in several factor ana- 
lytic studies; therefore when a multi-dimension study is made, these 
are the factors which should be utilized. Ideally only one polar 




30 



I 



pair which would be perfectly reliable should be used* Since no 
polar pair is perfectly aligned or perfectly reliable, about three 
polar pairs per factor, nine per concept, are normally used. Polar 
pairs should be chosen so that they load maximally one factor and 
minimally the other two factors. 

The construction of the semantic differential scale used in this 
study followed the procedures stated above. The concepts used were 
chosen from a large list of concepts concerning achievement motivation 
gleaned from professional literature, a thesaurus, dictionaries, and 
other diverse sources. This list was studied with the aid of a jury 
consisting of colleagues in the psychology field, and the final 
concepts were chosen with the expectation that they would discrimi- 
nate between those students likely to achieve high grades and those 
students who would not be likely to achieve high grades. The con- 
cepts chosen were academic honor society, future, me as I would like 
to be, me as I am, achievement, tests, failure, cheating, studying, 
college graduate, quitting school, and reading. The polar pairs 
were selected from Osgood and were those identified through factor 
analysis as having the highest loadings on the evaluative, potency, 
and activity factors. The polar pairs chosen to represent the evalua- 
tive factor were as follows: good -bad, beautiful -ugly, and nice-awful; 

for the potsney factor: large-small, heavy- light, and strong-weak; 

for the activity factor: dull-sharp, passive-active, and slow-fast. 

The concepts were presented two per page and were assigned to 
their respective positions by drawing them from a hat. Polar pairs 
were also randomized as to sequence and as to direction. This ran- 
domization procedure was recommended to reduce possible transfer 
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effect in marking. 



Subjects 

The subjects consisted of students enrolled in twelve sections 
of freshman orientation. An attempt was made to include the entire 
freshman enrollment of the fall of 1967; however the week scheduled 
for the administration of the scale was extremely cold, and the high- 
ways were icy. Many commuting students were absent on the day 
when they were scheduled to take the scale. No attempt was made 
to secure scores from absent students. Absences, incomplete data, 
or incorrectly marked scales reduced the total number of subjects to 
944, of which 524 were male and 420 were female. The age and aca- 
demic aptitude characteristics are present in Table I. Comparison 
of these students with former freshman groups indicate that they 
are typical of past freshman classes enrolled at Northeastern State 
College. 



TABLE I 

AGE AND APTITUDE CHARACTERISTICS OF SUBJECTS 



Academic Aptitude* Age 



Group 


M 


<r 


Range 






M 


Range 


Females 
N * 420 


16.76* 


4.50 


4-28* 


18 


yrs., 3 


mons., 5 days 


17 yrs,, 5 mons., 
--45 yrs. 


Males 
N * 544 


17.51* 


4.84 


3-30* 


18 


yrs, 7 


mons, 25 days 


17 yrs, 2 mons. 
--40 yrs., 6 mons. 


Total 
N = 944 


17.18* 


i.69 


3-30 











* American College Testing Program (ACT) scores 



Administration of the scale 

The semantic differential scale devised for use in this inves- 
tigation was administered by the investigator to eight of the classes-- 
two classes for each of the four orientation instructors. Each orien- 
tation instructor administered the scale to the last of his three 
classes. The scales were administered during the second week in 
January. Some students who had entered Northeastern State College 
as freshmen had withdrawn prior to this time and were therefore not 
available for inclusion in the subject population. Since the cri- 
terion of achievement was the grade point average at the end of the 
fall semester I little could have been gained by administering the 
scales to students for whom this grade point average was not available. 

Scoring of the Scale 

The seven point system recommended by Osgood (1957) was utilized, 
and scoring was done by hand. Scores were determined for the evalua- 
tive, potency, and activity factors for each concept; additionally 
a fourth score was obtained by summing the three factor scores on 
each concept. The latter procedure is neither recommended nor pro- 
hibited by Osgood, but it is commonly used. 

Statistical procedure 

The statistical procedure was not formulated at the time the 
original precis was submitted. As specified in the precis, the data 
obtained from the administration of the semantic differential scale 
were to be processed by the method which would best determine the 



value of the data in predicting achievement. After a discussion of 
the issues with consultants of the Oklahoma Statp University Computer 
Center where the data was processed, a step-wise regression procedure 
was adopted. This procedure yields the means of all concepts, corre- 
lations between concepts, correlations between concepts and criterion, 
standard errors, and F values. This procedure also yields Beta weights 
for formulating regression equations with which to predict the criterion 
score. As many regression equations as there are variables (concepts 
in this study) can be formulated, since the first regression equation 
presented contains only one variable, the second regression equation 
contains two variables, etc. The order of presentation of variables 
in the regression equation is based on the extent to which the variable 
contributes to the overall ability of the equation to predict the 
criterion score. The variable contributing most is presented first, 
the variable contributing the second most is presented second, etc. 

The addition of each variable is referred to as a "step." Each 
step is accompanied by a multiple correlation coefficient showing 
the degree to which the combined variables included through this step 
relate to the criterion score. Standard errors and F values are also 
included for each step. The advantage of this technique is obvious 
in that multiple regression equations can be terminated at a point 
where the use of additional variables ceases to increase the degree 
of forecasting efficiency. The technique also uses all variables 
to predict a student grade and then contrasts the predicted grade 
with the attained grade. 

In the step-wise regression technique several different factors 
may be used to determine the order in which concepts enter the regres- 
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Sion equation. For this study partial correlations were utilized. 

The technique has been criticized from the standpoint of validity 
in that if enough simple correlations are generated, a high 
multiple correlation can be obtained even if the data are 
absolutely random. If the data meet the assumption of continuity 
and if a number of repeat patterns are obtained, then the data 
would not be considered random and therefore the problem of 
validity is resolved. 

The step-wise regression technique was applied to groiq>ed 
male and female students with the evaluative, potency, and 
activity factors treated separately; the factor scores were then 
combined for each concept into a total score which was subjected 
to the same statistical treatment. Male and female scores were 
treated separately in the study, since earlier studies indicated 
that prediction based on a combination of male and female semantic 
differential scores was not as high as prediction based on scores 
from separate male and female groups. 

Students having the same academic ability will not necessarily 
make the same grade point average. A regression analysis of selected 
academic aptitude levels was computed to determine whether the 
semantic differential scale used in the study would identify the 
extent to which students of equal academic ability were likely to 
differ in achievement. The researcher believed that the academic 
aptitude level could differentially affect the extent to which the 
semantic differential scale would discriminate between high and low 
achieving students of the same ability level; therefore three levels 
of academic aptitude were chosen based on the students ' ACT scores . 



These levels were twenty-two, which is jvst above one standard devia- 
tion above the mean for Northeastern State College freshmen; seventeen, 
which is the score nearest the mean; and twelve, which is just under 
on standard deviation below the mean. Male and female groups based 
on these criteria were treated as outlined above. 

There is the possibility that the semantic differential scale 
can be combined with known academic aptitude scores (in this case 
^scores), and the combination will predict achievement better than 
either measure will predict individually. To test this hypothesis, 
the ACT scores were combined as another factor in a regression analysis. 
Other procedures were identical with those outlined earlier. 

The question of male- female differentiation in response to the 
scale was investigated by use of the standard error of the multiple 
correlation. 



Summary 

Semantic differential scales measuring concepts dealing with 
academic achievement were formulated and administered to beginning 
freshmen during the fall term of 1967. A reliability study of the 
scale was made by readministering the scales to a selected random 
sample of students. Scoring of the scales was accomplished by applying 
a seven-point scale to the polar pairs and summing the values of the 
polar pairs corresponding to the evaluative, potency, and activity 
factors under each concept; a total score was also obtained by 
summing the factor scores for each concept. A step-wise regression 
technique was used as the statistical treatment. Hale and female 
students were grouped separately, since previous research indicated 
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a sex difference with respect to answers on semantic differential 
scales. In addition to general regression analysis for male and 
female students, students having ACT scores of seventeen, twelve, and 
twenty-two were treated separately to determine the extent to which 
the semantic differential scale could predict differential achievement 
between students having the same academic aptitude score at average, 
low, and high aptitude levels. The semantic differential scores 
were combined with scores to determine whether the combination 
could enable better prediction than could either scale by itself. 

In the next chapter, the statistical procedures are applied to 
the data and the findings are presented and discussed. 
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CHAPTER 3 



FINDINGS 

In this study acceptance or rejectance was sought for the following 
null hypotheses: 

1. There are no significant relationships between scores on 
the semantic differential scales devised for this study 
and grade point averages of students who have the same 

ACT scores. 

2. A combination of semantic differential scores and ACT 
scores does not predict significantly better than either 
measure will predict alone. 

Additionally, the study sought to determine the reliability of the 
semantic differential scale devised for the study, and to determine 
whether sex differences exist with respect to semantic differential 

scale answers. 

This chapter will present the statistical analysis of obtained 
data pertaining to these basic questions. 

Statistical Procedures 

The statistical procedure used to compare semantic differential 
scale scores with the criterion— grade point average— was the step- 
wise regression technique. The scales were hand scored and the data 
thus derived was processed by the Oklahoma State University Computer 
Center. Statistics furnished by the center included means, corre- 
lations between concepts, correlations between concepts and the cri- 
terion, standard errors, revalues for Beta weights, and Beta weights 
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for each variable as it enters into a regression equation. Regression 
equations of the form Y = Bo + BiXi...BnXn were formulated for each 
group specified in the study. The equations were terminated at the 
point where the F value with its respective degrees of freedom in- 
dicated that the next variable did not contribute significantly to 
the ongoing value of the equation. The terminal multiple correlation 
as derived by each regression equation was checked for its significance 
by the use of the formula for F_ with respect to multiple correlation 
found in Ferguson (1966, p. 401): 



F 



r2 n - k - 1 

1 - R2 ^ k 



where N is the number of observations, R is the multiple correlation, 
and k is the number of independent variables. A standard ^ table is 
entered with k the value of the degrees of freedom for the numerator, 
and N - k - 1 for the denominator. Significance was checked at the 
.01 and .05 levels of confidence. 

The question of difference between male and female answers on the 
semantic differential scale was checked by using Garrett's (1966, 
p. 416) formula for the SE with respect to multiple correlation: 

SEr « 1 - R^ 

N - m 

where R is the multiple correlation, N is the number of observations, 
and m is the number of variables. The standard error thus determined 
was then multiplied by the normal curve value for the .05 level of 
confidence (1.96) and the result added to and subtracted from the 
multiple correlation. The companion correlation from a pair of male- 
female multiple correlations was given the same treatment. The ex- 
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tended correlations are then compared; if an overlap in value occurs, 
the samples from which the multiple correlations are computed seemingly 
originate within the same or a similar population; if no overlap 
occurs then a significant difference is believed to exist between 
the parent populations at the .05 level of confidence. 

The question of scale reliability was studied by the test-retest 
method in which students were given the same scales with an inter- 
vening time period. The results of each administration were corre- 
lated and the significance of the correlation was determined by using 
a "t" test. Since the question of scale reliability is of prime 
importance to the remainder of the study, the findings concerning 
reliability were presented first. 

Reliability 

The reliability of the semantic differential scale used in this 
study was determined by randomly choosing three orientation classes 
(N - 72) and using the test-retest method with a one-week time inter- 
val between administrations. Scores were summed across concepts into 
evaluative, potency, and activity factor scores, and a total score 
consisting of the summation of all scores. ProducT^f moment correlations 
and "t" tests were computed for each factor and the summation. The 
results are shown on Table 2. The correlation for the evaluative 
factor was .796 for the potency factor .60?, for the activity factor 
,850, and for the summation .817. All correlations were significant 
above the .001 level of confidence. The reliability of the scales 
is of sufficient magnitude that further study seems warranted. 
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TABLE 2 



TEST-RETEST RELIABILITY OF THE SEMANTIC DIFFERENTIAL SCALE FOR THE 
EVALUATIVE, POTENCY, AND ACTIVITY FACTORS AND THE TOTAL SUMMATION SCORE 





Evaluative 
test retest 


Potency 

test retest 


Activity 

test retest 


Total 

test retest 


Mean 


161.09 161.53 


158.15 159.76 


165. S: 165.43 


485.17 486.99 


s 


16.56 16.78 


15.86 16.07 


18.05 17.67 


45.51 42.16 


r 


.796 


.601 


.850 


.817 


t 


11.00* * 


6.29* 


13.50* 


11.86* 


N = 72 


df = 70 *all 


significant above 


the .001 level of confidence. 



Hypothesis 1 

A major purpose of this study was to determine the extent to 
which the scale devised for the study would discriminate in grade 
prediction between students having equal academic ability. To in- 
vestigate this question the semantic differential scale scores of 
groups of students having ^ scores of 12, 17, and 22 with each ^ 
level further subdivided into male and female components, were each 
subjected to separate step-wise regression analysis for the evalua- 
tive, potency, activity and total factor scores. 

Evaluative factor 

A significant multiple correlation (R « 0.698**) was found for 
males of ACT- 12 (N = 23). Two concepts (variables) contributed 
significantly to the multiple regression equation: tests** and 

studying*. The males of ACT- 17 (N = 33) had an R = 0.483* with the 
concepts achievement*** and me as^ woul^ contributing. 

*** non-significant 

** significant at the .01 level of confidence 

* significant at the .05 level of confidence 
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The concept achievement was non-significant but entered first and there- 
fore must be included in the regression equation which yielded a signifi 
cant R. A significant R was not found for males of ACT- 22. 

The females of ACT- 12 (N = 20) had no significant R. Females 
of ACT- 17 (N = 27) had an R ■ 0.494* with only the concept failure* * 
contributing. 

The data for these groups are found in Table 3 and Appendix B. 



TABLE 3 





EVALUATIVE 


FACTOR FOR 


12, 17, and 22 J£T LEVELS 




ACT 

Level 


N 


df 


Cut-off 

Rl 


Variables 
entering at 
significant 
level 


Maximum R (12 
variables) 


Males 


12 


23 


2,20 


0.698** 


tests** 


0.816 


17 


33 


2,30 


0.483* 


achievement*** 

me as I would like to be* 


0.701 


22 


21 




none 


none 


0.665 


Females 


12 


20 




none 


none 


0.755 


17 


27 


1,25 


0.494* 


failure** 


0.594 


22 


14 


2,11 


0.752* 


studying** 
me as I am* 


0.998 



***non-significant 

**significant at the .01 level of confidence 
* significant at the .05 level of confidence 
^Multiple correlation coafficiant cut-off at point where additional 
variables do not add significantly. 
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Potency factor 



Males of ACT- 12 (N = 25) had An R = 0.774**with the concepts 
academic honor society* **, cheating* , reading* , and me as^ I_ am* 
contributing. Males of ACT- 17 (N * 33) had an R * 0.431** with 
only the concept academic honor society* contributing. A significant 
R for males of ACT- 22 w as not found. 

Females of ACT- 12 (N = 20) had an R = 0.797** with the concepts 
academic honor society* ** , future* , me as_ I *d like to be* , and quitting 
school* contributing. Females of ACT- 17 (N = 27) haa an R = 0.383* 
with only the concept achievement* contributing. Females of ACT-j2 
(N = 14) had an R = 0.824** with the concepts tests* * and me as I'd 
like to be* contributing. 

Data for these groups on the potency factor are found in Table 4 
and Appendix B. 

Activity factor 

The only significant R found for the activity factor was from female 
ACT- 12 (N = 20) which had an R = 0.490* with only the concept future* 
contributing. Data for these groups on the activity factor are found 
in Table 5 and Appendix B. 

Factor summation 

No significant R* s were found for males of ACT- 12 and ACT- 17 . The 
entry R for males of ACT -22 was significant at the .05 level of confidence 
but no concept had an £ value sufficiently great to allow it to enter a 
regression equation at a significant level. 

*** non-significant 

** significant at the .01 level of confidence 
* significant at the .05 level of confidence 
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TABLE 4 



POTENCY FACTOR FOR 12, 17, and 22 ACT LEVELS 



ACT 

Level 


N 


df 


Cut-off 

Rl 


Variables 
entering at 
significant 
level 


Maximum R 
(12 variables) 


Males 












12 


23 


4,18 


0.774** 


academic honor 
society*** 
cheating** 
reading* 


0.859 


17 


33 


1,31 


0.431** 


academic honor society* 


0.642 


22 


21 


none 


none 


none 


0.764 


Females 












12 


20 


4,15 


0.797** 


academic honor society*** 
future* 

me as I'd like to be* 
quitting school* 


0.870 


17 


27 


1,25 


0.383* 


achievement* 


0.660 


22 


14 


2,12 


0.824** 


tests** 

me as I'd like to be* 


1.000 


*** non-significant 
** significant at the 


.01 level 


of confidence 





* significant at the .05 level of confidence 
Hlultiple correlation coefficient cut-off at point where additional 
variables do not add significantly. 



Females of ACT- 12 (N ■ 20) had an R ■ 0.866** with u.c concepts 
future* , me as^ am***, reading* , cheating* **, and academic honor 
society* contributing. Females of ACT- 22 (N = 14) did not have an R 
which was significant. 

*** non- significant 

** significant at the .01 level of confidence 
* significant at the .05 level of confidence 
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Data for these groups are found in Table 6 and Appendix B. 

TABLE 5 

ACTIVITY FACTOR FOR 12, 17, and 22 ACT LEVELS 



ACT 

Level 


N 


df 


Cut-off 

r1 


Variables 
entering at 
significant 
level 


Maximum R 
(12 variables) 


Males 












12 


23 


none 


none 


none 


0.713 


17 


33 


none 


none 


none 


0.742 


22 


21 


none 


none 


none 


0.616 


Females 












12 


20 


1.18 


0.490 


future* 


0.318 


17 


27 


none 


none 


none 


0.675 


22 


14 


none 


none 


none 


0.999 



*significant at the .05 level of confidence 

^Multiple correlation coefficient cut-off at point where additional 
variables do not add significantly. 

Discussion 

The regression analysis of the semantic differential scale scores 
yielded multiple correlations which were significant at or greater than 
the .05 level of confidence for the male and female subjects of the 12, 
17, and 22 A£T score levels investigated. However, not all factors dis- 
criminated for all groups; and in one instance- -the males of the 22 ACT 
score level --the entry multiple correlation was significant but no 
concept entered into the regression equation at a significant level. 




45 



1 



table 6 

TOTAL FACTORS FOR 12, 17, and 22 ACT LEVELS 



ACT 

Level 


N 


df 


Cut-Cff 

R* 


Variables 
entering at 
significant 
level 


Maximum R 
(12 variables) 


Males 


12 


23 




none 


none 


0.706 


17 


33 




none 


none 


0.624 


22 


21 




0.354* 


none 


0.667 


Females 


12 


20 


5,14 


0.866* 


future* 
me as I am*** 
reading* 
cheating*** 

academic honor society* 


0.919 


17 


27 


5,21 


0.839** 


failure** 
cheating*** 
college graduate*** 
tests* 


0.887 


22 


14 




none 


none 


0.796 



*** non-significant 

** significant at the .01 level of confidence 



* significant at the .05 level of confidence 
4lultiple correlation coefficient cut-off at point where additional 
variables do not add significantly. 



Since relationships significant at or above the .05 level of con- 
fidence were found between grades and semantic differential scale scores 
for the various groups used in the investigation of Hypothesis 1, this 
hypothesis stated in the form of a null hypothesis must be rejected and 
the alternate hypothesis accepted. Significant relationships do exist 
between semantic differential scores and grade point averages of students 
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having the same ACT scores. 

Discussion of concepts- -Hypotehs is 1. 

All twelve concepts entered into the regression equations computed 
from data from the ACT 12, 17, and 22 levels. Only one concept entered 
as many as four times- - academic honor society- -and two of the four times 
it entered at a non-significant level but entered before a significant 
concept and therefore was included in the appropriate regression equation. 
Only two concepts entered as few as one time each-- quitting school and 
college graduate . The concept college graduate was non-significant. 

Those concepts entering three times were tests , cheating , me as am, 
failure, future, and me as_ I *d like to be . The concept tests was the 
most effective predictor in that two of the three times it entered it 
was significant at the .01 level of confidence; no other concept was 
significant at this level more than once. 

In this portion of the study, the potency factor had twelve concepts 
entering regression equations with two significant at the .01 level of 
significance, eight significant at the .05 level of confidence, and two 
which were non-significant. The summation of factors scale had ten con- 
cepts entering of which one was significant at the .01 level of confidence, 
six were significant at the .05 level of confidence, and three were non- 
significant. The evaluative factor had seven concepts which entered the 
regression equation of which two were significant at the .01 level of 
confidence, four were significant at the .05 level of confidence, and one 
was non-significant. The activity factor had only one concept which was 
significant as high as the .05 level of confidence. 

A summarization of the number and significance of concepts which 
entered into regression equations tor each ACT level by sex discloses that 

er|c 
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male-ACT-12 had three concepts significant at the .05 level of confidence 



and one concept non-significant for the potency factor, one concept signifi- 
cant at the .05 level of confidence, and one non-significant concept for 
the eA^aluative factor. Tliere were no significant concepts for the male- 
ACT-22 group, tlie femalc-ACT-12 had three concepts significant at the .05 
level of confidence and one non-significant concept for the potency factor; 
one concept was significant at the .05 level of confidence for the 
activity factor, and three concepts were significant at the .05 level of 
confidence, while two concepts were non-significant for the summation of 
factors scores. Female-ACT-17 had one concept significant at the .01 level 
of confidence for the potency factor; one concept significant at the .01 
level of confidence for the evaluative factor; and, one concept significant 
at the .01 level of confidence, three concepts significant at the .05 level 
of confidence, and one non-significant concept for the summation of factors 
scores. Female-ACT-22 had one concept significant at each the .01 and .05 
levels of confidence for the potency factor, and one concept significant 
at each the .01 and .05 levels of confidence for the evaluative factor. 

Data for this section are presented in Table 7. 

Hypothesis 2 

A second purpose of this study was to determine if the scale de- 
vised for this study could be combined with the ACT scores and thus be 
a better instrument of prediction than either the ACT or the semantic 
differential scale alone. To test this hypothesis, the ACT was added to 
the step-wise regression analysis as another variable and the same 
statistical procedures used in testing the first hypothesis were followed. 
The scores of the males and females were analyzed separately and were then 
added together and analyzed as a total group. 
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TABLE 7 

CONCEPTS --SIGNIFICANCE LEVELS AND GROUPS FOR WHICH THEY PREDICT 



Concept 




Group 


Academic honor society 


Potency 


Male-ACT-12*** 

Female-ACT-12*** 

Male-ACT-17* 




Total 


Female-ACT-12* 


Cheating 


Potency 


Male-ACT-12* 




Total 


Female-ACT-12*** 

Female-ACT-17* 


Tests 


Potency 


Female-ACT-22** 




Evaluation 


Male-ACT-12** 


Me as I am 


Potency 


Male-ACT-12* 




Evaluation 


Female-ACT-22* 




Total 


Female-ACT-12*** 


Me as I'd like to be 


Potency 


Female-ACT-12* 

Female-ACT-22** 




Evaluation 


Male-ACT-17* 


Future 


Potency 


Female-ACT-12* 




Total 


Female-ACT-12* 

Female-ACT-17* 


Studying 


Evaluative 


Male-ACT-12* 

Female-ACT-22* 


Failure 


Evaluative 


Female-ACT-17** 




Total 


Female-ACT-12* 




Activity 


Female-ACr-12* 


Reading 


Potency 


Male-ACT-12* 




Total 


Female-ACT-12* 


Achievement 


Potency 


Female-ACT-17* 




Evaluation 


Male-ACT-17*** 


Quitting school 


Potency 


Female-ACT-12* 


College graduate 


Total 


Female-ACT-17*** 



* significant ac .05 level of confidence 
** significant at .01 level of confidence 
*** non-significant 
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The ACT score was the most important factor and entered each 
regression equation first. The correlation coefficient between the grade 
point average and ACT scores for 524 males was 0.493; for 420 females it 
was 0.529, and for 944 males and female subjects it was 0.500. 

Males 

For the evaluative factor and the male group, the cut-off R was 
0.530** which was a zero-order improvement of .037 correlation points. 

The concepts which entered the regression equation were the ACT -score 

tests**, and achievement* *. The potency factor and the male group 

yielded an R of 0.508** which was a zero-order improvement of 0.015 correlation 

points. Two concepts entered the regression equation-- ACT scores* *, and 

studying* *. 

The activity factor and the male group yielded an R of 0.520** 
which was a zero-order improvement of 0.027 correlation points. Three 
concepts entered the regression equation-- ACT score* *, achievement**, 
and studying* * . The factor summation scores and the male group yielded 
an R of 0.532** which was a zero-order improvement of 0.039 correlation 
points. Six concepts entered the regression equation- ACT-scores* * , 
tests**, achievement* *, me as I would like to be**, academic honor society* *, 
and studying* *. The data for the male group are found in Table 8 and 
Appendix C. 

** significant at the .01 level of confidence 

* significant at the .05 level of confidence 
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